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Abstract. Given the high prevalence of Tier 2 behavioral intervention use and 
calls to examine mediation and moderation effects on treatment for children, this 
study tested the mediation effect of the daily progress report and moderation 
effects of coach-student, teacher-student, and student-teacher relationships and 
their interactions for 95 elementary school students who received the Check, 
Connect, and Expect intervention. The only significant finding was the moderat¬ 
ing effect of the student-teacher and teacher-student relationships. A significant 
interaction between the moderating effects showed that a positive student-teacher 
relationship showed overall reductions in total problem behavior across an aca¬ 
demic year. This result is interpreted as students’ perception of a positive 
relationship with their teacher as critical to the therapeutic mechanism of Tier 2 
behavioral interventions. 


A review of school-wide positive behav¬ 
ior support (SWPBS) research indicates that it 
grew from a need to replace reactive punitive 
practices such as suspensions and expulsions by 
increasing students’ social competency (Mc¬ 
Intosh, Filter, Bennett, Ryan, & Sugai, 2010). 
According to the Positive Behavioral Interven¬ 
tions & Supports (PBIS) website (PBIS, Of¬ 
fice of Special Education Programs, n.d., 
“Tier 1 FAQs” Web page), 3-tiered SWPBS 
was developed based on research-based inter¬ 
ventions and it is estimated that over 7,000 
schools currently implement SWPBS. Tier 1 is 
designed to help staff teach school-wide social 
behavior expectations (Crone, Horner, & 
Hawken, 2004). Tier 2 is designed for students 


who are unresponsive to Tier 1 intervention 
(Crone et al., 2004; Walker et al., 1996), and 
finally, Tier 3 is designed for students exhib¬ 
iting chronic behavior problems (Sugai & 
Horner, 2006; Walker et al., 1996). This study 
focuses on the therapeutic mechanisms of a 
Tier 2 SWPBS program, Check, Connect, and 
Expect (CCE), by testing mediating and mod¬ 
erating variable effects on student problem 
behavior outcomes. This research is needed to 
promote our understanding of how CCE works, 
which in turn can influence our future imple¬ 
mentation efforts (Kazdin & Nock, 2003). 

The rationale for evaluating the thera¬ 
peutic mechanism of a Tier 2 SWPBS pro¬ 
gram is that, because of the need for increased 
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intervention efforts across a larger number of 
students, these programs require more re¬ 
sources to efficiently identify children who 
need help, train teachers and staff, and com¬ 
municate with stakeholders (e.g., 15%-20%; 
Crone et al., 2004). There are several pro¬ 
grams that can fit within an SWPBS approach; 
the Office of Special Education Programs 
PBIS Technical Assistance Center (PBIS, Of¬ 
fice of Special Education Programs, n.d., 
“Tier 2 supports” Web page) lists the follow¬ 
ing Tier 2 interventions for consideration based 
on research: Check & Connect (C&C; Sinclair, 
Christenson, Evelo, & Hurley, 1998), Check-In 
and Check-Out (CICO; Todd, Campbell, Meyer, 
& Homer, 2008), the CCE program (Cheney et 
al., 2009), social skills instruction, and First 
Steps to Success (Walker, Severson, Feil, Stiller, 
& Golly, 1998). 

Most of these Tier 2 interventions com¬ 
monly use a teacher and/or a coach or mentor 
to give daily behavioral feedback to the at-risk 
students. This feedback can be critical because 
increasing student-teacher positive interac¬ 
tions and reducing the number of negative 
interactions may act as mediating mechanisms 
to improve student social competence (Mc¬ 
Intosh et al., 2010). In support of the adult- 
student therapeutic effect, a meta-analysis of 
positive child-therapist relationships on be¬ 
havioral symptom outcomes found an overall 
effect size of 0.32 (Shirk, Karver, & Brown, 
2011). In another study, in a clinical sample 
of 90 children receiving treatment for aggres¬ 
sive, oppositional, and antisocial behavior, 
Kazdin and Durbin (2012) found that, as the 
quality of the child-therapist therapeutic rela¬ 
tionship increased, so did the positive behav¬ 
ioral outcomes. 

However, there are some slight differ¬ 
ences in the emphasis of purported therapeutic 
mechanisms for each Tier 2 intervention re¬ 
viewed below. C&C is predicated on a posi¬ 
tive interpersonal relationship between the 
coach and the student (Sinclair et al., 1998). In 
contrast, the mechanism for behavior change 
with CICO is predicated on more specific 
feedback derived from an adult mentor and the 
teachers’ evaluation of students’ behavior on a 
behavior expectation report card (Todd et al., 


2008). The therapeutic mechanisms for the 
CCE program include positive interpersonal 
relationships between the coach and the stu¬ 
dent and between the teacher and the student, 
as well as explicit behavioral feedback on 
school-wide behavior expectations (Cheney et 
al., 2009). Even though for each of these in¬ 
terventions, there is a stated therapeutic mech¬ 
anism for changing student behavior, to our 
knowledge, none has been statistically tested. 

A BRIEF OVERVIEW OF THE 
PROCEDURES AND OUTCOMES OF 
C&C, CICO, AND CCE 

In this section, a short description of the 
selected Tier 2 interventions is provided in 
addition to some research evidence to support 
their use. The initial C&C intervention pro¬ 
gram was designed to increase school engage¬ 
ment for middle and high school students with 
learning or emotional disabilities who were at 
risk for dropping out of school (Sinclair et al., 
1998). The therapeutic mechanism for the 
C&C program is derived from Comer’s (1984) 
postulate: “It is the attachment and identifica¬ 
tion with a meaningful adult that motivates or 
reinforces a child’s desire to learn” (p. 327). In 
C&C, each student has a monitor who checks 
the student’s attendance, tardiness, office re¬ 
ferrals, and school suspensions and checks for 
failing class grades. The connection with the 
student is implemented at two different levels. 
At the basic level, the mentor meets with the 
student and provides feedback about the stu¬ 
dent’s school engagement as well as the im¬ 
portance of staying in school. They engage in 
problem solving (Braswell & Bloomquist, 
1991) for any at-risk behaviors needing atten¬ 
tion. The C&C student receives the intensive 
intervention if the mentor finds that the stu¬ 
dent’s risk has increased based on the behav¬ 
ioral data described above. The intensive in¬ 
tervention includes more detailed problem 
solving for negotiating alternatives to suspen¬ 
sions, the use of behavioral and/or academic 
contracts and family mediation for truancy, 
social skills instruction, and teacher-student 
consultation. Results showed that the treat¬ 
ment group had better attendance, academic 
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assignment completion, number of school 
credits earned, and enrollment but mixed re¬ 
sults regarding general educators’ and special 
educators’ evaluation of the students’ problem 
behavior and academic competence (Sinclair 
et al„ 1998). 

Anderson, Christenson, Sinclair, and 
Lehr (2004) explicitly tested the quality of the 
perceived mentor-student relationship and the 
student-mentor relationship on the students’ 
academic performance (e.g., completes work 
at 80% or above) and appropriate social be¬ 
havior (e.g., compliance and follows school 
rules) for 80 elementary and middle school 
students who were enrolled in the C&C inter¬ 
vention. Four regression analyses were con¬ 
ducted. The first analysis predicted academic 
performance after entering baseline levels of 
student absences, tardies, and demographic 
risk factors and then the mentor-student rela¬ 
tionship variable, which positively predicted 
students’ academic performance. The second 
regression entered the aforementioned base¬ 
line variables and then the student-mentor re¬ 
lationship variable, which approached signifi¬ 
cance. The third and fourth regression analy¬ 
ses followed the same format described above, 
although the dependent variable was the stu¬ 
dents’ appropriate social behavior. The results 
of both the third and fourth analyses found that 
the relationship variables did not predict ap¬ 
propriate student behavior. These results indi¬ 
cated that positive interpersonal relationships 
predict positive academic performance but not 
socially appropriate school behaviors. 

CICO is an intervention for students at 
risk for emotional and behavior difficulties 
that uses adult mentor feedback with a morn¬ 
ing check-in and an afternoon checkout; it also 
includes a formalized daily progress report 
(DPR) card completed by the teacher with 
verbal feedback that is sent home every day 
and includes the student’s performance on 
school-wide behavior expectations (e.g., be 
respectful, be responsible, and be safe). The 
DPR includes a description of daily behavior 
expectations and goals and whether or not 
those expectations are met. When students 
meet their daily goal, they receive a reward to 


reinforce their appropriate behavior (Fair¬ 
banks, Sugai, Guardino, & Lathrop, 2007). 

Filter et al. (2007) studied the effective¬ 
ness of the CICO program in reducing prob¬ 
lem behaviors with 19 students in three differ¬ 
ent elementary schools who were unrespon¬ 
sive to Tier 1 class-wide interventions. The 
results showed a significant decrease in office 
discipline referrals for 13 of the 19 students. In 
another CICO study, with 36 elementary school 
students, that evaluated the functional relation¬ 
ship of the students’ problem behavior (Mc¬ 
Intosh, Campbell, Carter, & Dickey, 2009), the 
results showed that students whose problem be¬ 
havior was motivated by escape-based conse¬ 
quences showed an increase in problem behavior 
and no improvement in prosocial behavior or 
decreased rate of office discipline referrals. 
Flowever, students whose problem behavior was 
maintained by teacher attention showed a de¬ 
crease in problem behavior, an improvement in 
social behavior, and a decrease in the rate of 
office discipline referrals. 

Together, these studies show the effective¬ 
ness of CICO but also indicate that students who 
are motivated by teacher social approval were 
the most likely to respond, whereas students 
motivated to escape academic tasks were not 
likely to make improvements in problem be¬ 
havior using this intervention. However, it is 
difficult to separate the active treatment ingre¬ 
dients in CICO because both reinforcement 
using the DPR and adult-student coaching are 
involved. 

The CCE program (Cheney et al., 2009) 
integrated components from the C&C and 
CICO programs. Similar to C&C, the students 
enrolled in CCE began at a basic level where 
the students checked in and checked out with 
a coach every day. Similar to CICO, the stu¬ 
dents received teacher feedback about their 
DPR performance, which was taken home to 
parents to review. The DPR points earned by 
the students over 2-week periods dictated the 
level of intervention received and when the 
students graduated from the program. 

A 2-year randomized treatment-control 
group study of CCE was conducted with 204 
at-risk elementary students (Cheney et al., 
2009). Sixty percent of the CCE students grad- 
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uated, and a linear growth curve analysis 
showed a significant decrease in the level and 
slope of externalizing and internalizing prob¬ 
lem behavior compared to controls; moreover, 
the graduates showed a reduction from border¬ 
line or clinical levels to normal levels of prob¬ 
lem behavior. 

Tsai and Cheney (2012) examined the 
therapeutic effects of coach-student and 
teacher-student relationships on four different 
dependent measures (i.e., social skills, prob¬ 
lem behaviors, academic competence, and en¬ 
gagement) using a hierarchical multiple re¬ 
gression model that used the screening instru¬ 
ment’s level of maladaptive behavior, the 
number of tangible rewards received, and the 
coach-student and teacher-student relation¬ 
ship measures. Prior maladaptive behavior ac¬ 
counted for a significant amount of the vari¬ 
ance in each outcome measure. The number of 
tangible rewards received for meeting behav¬ 
ior expectation goals was not predictive of any 
of the dependent variables, nor was the coach- 
student relationship variable. In the last step of 
the regression analysis, the teacher-student re¬ 
lationship measure was entered. It was signif¬ 
icantly related to each dependent variable, ac¬ 
counting for 5% to 29% of the variance. Tsai 
and Cheney suggested that similar to C&C, 
the CCE intervention showed that an adult- 
student relationship accounted for the variance 
beyond what the other variables accounted for 
in the student outcomes. However, they also 
noted that one limitation was that the teachers 
rated their relationship with the student and 
rated the students’ problem behavior, suggest¬ 
ing a potential mono-rater bias. In addition, 
the effect of student-teacher relationship was 
not tested. 

PURPOSE OF THE CURRENT STUDY 

Kazdin and Nock (2003) described the 
importance of testing mediating and moderat¬ 
ing variables in psychological intervention re¬ 
search for children. A complete mediating 
variable is a third variable (e.g., the treatment 
ingredient) that explains the variance in the 
therapeutic change in behavior, although par¬ 


tial mediating variables explain some of the 
variance (Baron & Kenny, 1986). 

Other researchers have shown that sta¬ 
tistical analysis of mediating variables is best 
demonstrated with longitudinal data regarding 
the change in the outcome behavior across 
time and that cross-sectional research designs 
can distort the results, yielding an inaccurate 
interpretation (Kraemer, Yesavage, Taylor, & 
Kupfer, 2000). The CCE training manual re¬ 
ports that a DPR should be used by teachers to 
provide positive behavioral feedback and con¬ 
tingent social reinforcement to students if their 
daily percent is at or above 75% (Cheney et 
al., 2004). In addition, the manual states that 
behavioral specialists should use students’ av¬ 
erage DPR performance to make treatment 
intervention changes on a biweekly basis 
(Cheney et al., 2004). The current study there¬ 
fore used students’ average DPR percentage 
over the course of the academic year as a 
mediating variable for the CCE therapeutic 
mechanism. 

A 1 -year validity study of DPRs showed 
the construct validity between students’ fac¬ 
tor-analyzed change scores for externalizing 
problem behaviors and their average level of 
DPR was r = .32, p < .05 (Stage, Cheney, 
Lynass, Mielenz, & Flower, 2012). The stu¬ 
dents’ average DPR percentage and final CCE 
treatment intervention placement were also as¬ 
sessed in relation to their level of problem 
behavior. The five CCE intervention levels 
were used to statistically discriminate the low¬ 
est to the highest treatment intensity levels by 
students’ average DPR percentage and stu¬ 
dents’ problem behavior. Results showed that 
the CCE graduate group’s average DPR was 
99% and its average problem behavior T score 
was 56, which is within the normal range. The 
CCE self-monitoring group’s average DPR 
was 95% and its average T score was 61, 
which is at the lowest end of the borderline 
clinical range T score. The CCE basic group’s 
average DPR was 87% and its T score was 62, 
which is in the borderline clinical range. The 
CCE basic-plus group’s average DPR was 
78% and its T score was 67, which is in the 
borderline to clinical range. Finally, the CCE 
intensive intervention group’s average DPR 
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was 75% and its average problem behavior T 
score was 69, which is in the clinical range. 
Given the moderate correlation between the 
students’ average DPR percentage and teach¬ 
ers’ assessment of their problem behavior and 
the behavioral specialists’ student assignment 
to intervention level based on their average 
DPR percentage, which was shown to signif¬ 
icantly discriminate between level of severity 
on a standardized measure of problem behav¬ 
ior, the current study used DPR average as a 
proximal variable of mediation (Hoyle & 
Kenny, 1999) to assess the therapeutic mech¬ 
anism of CCE. 

The second purpose of the study was to 
investigate the moderating variables of thera¬ 
peutic alliance regarding the students’ attitude 
about their teachers, the teachers’ relationship 
with the students, and the coaches’ relation¬ 
ship with the students. Moderation means that 
the effect of a variable on an outcome is al¬ 
tered (i.e., moderated) by a covariate. Moder¬ 
ation is usually assessed by determining if 
there is an interaction between the initial vari¬ 
able and the covariate (Kenny, 2015). In the 
CCE program, the coaches were trained on the 
C&C model (Sinclair et al., 1998), which em¬ 
phasized the interpersonal relationship of the 
coach with the student (Anderson et al., 2004). 
Even though Tsai and Cheney (2012) found 
that the coach-student relationship did not 
predict the students’ behavior outcomes but 
that the teacher-student relationship did, this 
study aimed to confirm or disconfirm this re¬ 
sult using a design and statistical analysis that 
would test them separately. What has not been 
tested in the Tier 2 behavioral intervention 
research, to our knowledge, is the interaction 
between student-teacher and teacher-student 
relationships on therapeutic outcomes, which 
seems like a logical extension given the notion 
of therapeutic alliance (i.e., therapeutic alli¬ 
ance is dictated by the interaction of both 
participants in the relationship). 

In conclusion, our hypotheses were as 
follows: (a) CCE students’ DPR average 
across the academic year would mediate their 
reduction in total problem behavior (Cheney et 
al., 2009; Stage et al., 2012). (b) Measures of 
the coach-student relationship would not 


moderate the level of change in total problem 
behavior over the year (Anderson et al., 2004; 
Tsai & Cheney, 2012). (c) The measure of 
teacher-student relationship would moderate 
the level of reduction in total problem behav¬ 
ior during the same period (Tsai & Cheney, 
2012). (d) The measure of student-teacher re¬ 
lationship would moderate the level of reduc¬ 
tion in total problem behavior over the aca¬ 
demic year (Kazdin & Durbin, 2012). (e) The 
interaction between the measures of the stu¬ 
dent-teacher and teacher-student relationships 
would provide the most robust moderation of 
the teachers’ rating of students’ change in total 
problem behavior over the academic year. 

METHOD 

The method section includes a descrip¬ 
tion of participants. It also includes a descrip¬ 
tion of each of the measures used, the study 
procedure, and the analytic strategy used to 
test for the mediation and moderation effects. 

Participants 

The sample for the current study was 95 
elementary school students, which included 55 
students who had served as control partici¬ 
pants but were now receiving the CCE inter¬ 
vention (who had been enrolled as part of a 
federally funded grant, which was in its last 
year when this study was conducted) and 40 
students who had already been enrolled in the 
CCE intervention the previous 2 years. The 
students’ average age at the start of the inter¬ 
vention for the current study was 9.2 years 
(minimum = 8 years, maximum =11 years). 
Sixty-five percent of the students were male. 
Of the total sample, 7% were Asian or Pacific 
Islander, 8% were African American, 10% 
were Hispanic, and 54% were White. Thirty- 
three already had special education eligibility 
(10 with learning disabilities; 8 with attention 
deficit hyperactivity disorder; 7 with other 
health impairment; 3 with speech and lan¬ 
guage impairment; 2 with emotional distur¬ 
bance; and 1 each with autism, hearing impair¬ 
ment, and mental retardation). All were being 
served in the general education setting. Forty- 
three percent were eligible for free or reduced- 
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price lunch. Independent-samples t tests for 
interval variables and x 2 tests for frequency 
variables were conducted on the two samples 
because of the potential differences in the de¬ 
mographic and outcome variables within the 
study. None of these tests yielded a significant 
difference (p > .05). There were 15 schools 
hosting the intervention, each with its own 
coach, with 6.33 students per school on aver¬ 
age (SD = 3.45, Mdn = 5, minimum = 1, 
maximum = 12). There were 73 teachers; 5 
had 3 students, 12 had 2 students, and the rest 
had only 1 student (M = 1.3, Mdn = 1, 
SD = 0.59). 

Measures 

Systematic Screening for Behavior 
Disorders 

Systematic Screening for Behavior Dis¬ 
orders (SSBD; Walker & Severson, 1992) was 
used to screen all students prior to entry into 
the study. The teacher rated the top three nom¬ 
inated students on each list for externalizing 
and internalizing problem behavior on three 
indexes: Critical Events Index, Adaptive Be¬ 
havior Index, and Maladaptive Behavior In¬ 
dex. The Critical Events Index is composed 
of 33 items (e.g., steals, sets fires) that the 
teacher reports as occurring or not occurring. 
The SSBD Adaptive Behavior Index consists 
of 12 items that assess peer-related and teacher- 
related adaptive behavior on a 5-point scale. The 
Maladaptive Behavior Index is made up of 11 
items, which the teacher rates on a 5-point 
scale, assessing peer- and teacher-related 
problem behavior. The behavioral observa¬ 
tions in Stage 3 were not used in this study as 
other research has shown that this is not nec¬ 
essary (McKinney, Montague, & Hocutt, 
1998). 

The SSBD classification has a reported 
81% accuracy for students with externalizing 
problem behaviors, 68% for students with in¬ 
ternalizing problem behaviors, and 95% for 
students correctly not ranked by their teacher 
(Walker et al., 1990). Test-retest reliability 
over a 1-month period for the Critical Events 
Index, Adaptive Behavior Rating scale, and 
Maladaptive Behavior Rating scale was .81, 


.90, and .87, respectively (Walker et al., 
1990). From this study’s sample, a repeated- 
measures multivariate analysis of variance 
was conducted with the SSBD designation of 
the students as internalizing disordered or ex¬ 
ternalizing disordered as the independent vari¬ 
able and the students’ first assessment on the 
Teacher’s Report Form (TRF) internalizing 
problem behavior scale and TRF externalizing 
problem behavior scale as repeated dependent 
measures. The purpose of this analysis was to 
show that the SSBD classification category 
matched the elevation of the appropriate TRF 
scale. Results showed a significant interaction 
between SSBD student designation and eleva¬ 
tion on the repeated measures of internalizing 
and externalizing problem behavior. The SSBD 
internalizing disordered students’ TRF inter¬ 
nalizing problem behavior T score was 62.5, 
and their TRF externalizing problem behavior 
T score was 57.6. The SSBD externalizing 
disordered students’ TRF internalizing prob¬ 
lem behavior T score was 58.7, and their TRF 
externalizing problem behavior T score 
was 66.3 (-n 2 = .23). 

Child Behavior Checklist Teacher’s 
Report Form 

The Child Behavior Checklist Teacher’s 
Report Form (CBCL-TRF; Achenbach & Re- 
scorla, 2001) was normed for students be¬ 
tween the ages of 5 and 18 years. The Total 
Problem Behavior scale was developed with 
118 items rated using a 3-point rating scale: 
not true, somewhat or sometimes true, and 
very true or often true. Using Cronbach’s a 
with this sample, the internal consistency of 
the Total Problem Behavior scale was .84. 
Again with this study’s sample, students’ TRF 
Total Problem Behavior scores were corre¬ 
lated with the Problem Behavior scale of the 
Social Skills Rating System (Gresham & El¬ 
liott, 1990) at r = .79 and with the Interper¬ 
sonal subscale of the Behavioral and Emo¬ 
tional Rating Scale (BERS; Epstein, 2002) 
at r = -.62. The BERS is a strength-based 
assessment, so the negative correlation with 
problem behavior shows the anticipated in¬ 
verse relationship. These correlations sug¬ 
gested concurrent validity with problem be- 
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havior and strength-based interpersonal 
skills. 

Daily Progress Report 

The DPR (Crone et al., 2004) included 
three to five behavioral expectations that were 
evaluated by the teacher three times a day. The 
DPR rating scale was developed using a 
4-point scale that ranged from low/try again to 
excellent. Construct validity was tested with 
factor-analyzed change scores on standard¬ 
ized behavior rating scales with students’ 
average DPR scores at the end of the year 
(Stage et ah, 2012). The mean factor loading 
externalizing problem behavior change 
score was .850. The mean factor loading 
internalizing problem behavior change score 
was .704. The mean factor loading social 
skills change score was .649, and finally, the 
mean factor loading change score for aca¬ 
demic skills was .764. Only one of the fac¬ 
tor-analyzed change score domains pre¬ 
dicted students’ average DPR percentage at 
the end of the school year, externalizing 
problem behavior (r = .32, p < .05; Stage et 
al., 2012), suggesting a moderate degree of 
construct validity between average DPR 
percentage and externalizing problem be¬ 
havior. In addition, Stage et al. (2012) found 
a significant difference in students’ average 
DPR percentage and their externalizing 
problem behavior T scores in relation to the 
CCE treatment intervention levels. The CCE 
graduate group’s average DPR was 99%, 
and their average problem behavior T score 
was 56. The CCE self-monitoring group’s 
average DPR was 95%, and their average T 
score was 61. The CCE basic group’s aver¬ 
age DPR was 87%, and their average T score 
was 62. The CCE basic-plus group’s aver¬ 
age DPR was 78%, and their average T 
score 67. Finally, the CCE intensive inter¬ 
vention group’s average DPR was 75%, and 
their average problem behavior T score 
was 69. These findings further support the 
construct validity of the DPR with the match 
of the level of average DPR percentage and 
the level of problem behavior on a standard¬ 
ized behavior rating scale. 


Behavior Assessment System for Children, 
Second Edition 

The Behavior Assessment System for 
Children, Second Edition (BASC-2; Reynolds 
& Kamphaus, 2004) was developed to evalu¬ 
ate the behavior of children and young adults 
between the ages of 2 and 25 years. The 
BASC-2 has a 4-point scale (i.e., never, some¬ 
times, often, and almost always) and was de¬ 
signed to assess a variety of emotional and 
behavior disorders. 

For the purposes of the current study, an 
adapted version of the Attitude to Teachers 
scale was used to assess the students’ attitudes 
about their teacher. Examples of items include 
My teacher understands me and My teacher 
cares about me. The internal consistency of 
the Attitude to Teachers scale was reported to 
be .72. The internal consistency of the nine- 
item scale used in this study was .70 (R. Alt- 
mann, personal communication, December 2, 
2013). The Attitude to Teachers scale corre¬ 
lated with the School Problems scale at r = 
.84. 

Coach-Student and Teacher-Student 
Relationship Scales 

The Coach-Student Relationship and 
Teacher-Student Relationship scales were 
adapted from the Teacher and Student Monitor 
Form (Anderson et al., 2004). Both the 
Coach-Student Relationship and Teacher- 
Student Relationship scales (Cheney et al., 
2009) are composed of 15 items used to assess 
the coach’s and teacher’s relationship with the 
student. The coaches and teachers rated the 
items on a 5-point Likert scale (i.e., definitely 
does not apply, not really, neutral, applies 
sometimes, and definitely applies). Some ex¬ 
amples of the questions the teachers rated 
were The child and I always seem to be strug¬ 
gling with each other and This child values 
his/her relationship with me. Cronbach’s a for 
the Coach-Student Relationship and Teacher- 
Student Relationship scales was .81 and .83, 
respectively. 

Teacher Adherence and Quality Form 

Regarding the Teacher Adherence and 
Quality Form (Cheney et al., 2009), there are 
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six adherence items that were used to deter¬ 
mine if the teachers followed treatment integ¬ 
rity for providing student feedback. Examples 
included The teacher linked student behavior 
to posted behavior expectations and The 
teacher prompted the student to improve when 
needed. There are four quality statements that 
included The teacher uses a supportive tone of 
voice and The teacher reminded students of 
their strengths. After observing teacher feed¬ 
back, research staff rated the adherence state¬ 
ments as either occurring or not, and the qual¬ 
ity statements were rated on a 5-point Likert 
scale, ranging from did not occur to all the 
time. The Kuder-Richardson coefficient for 
the adherence items was .63, and Cronbach’s 
a for the quality items was .84. 

Procedures 

All students started at the CCE basic 
level at the beginning of the school year. At 
this level, the coach checked in with the stu¬ 
dent at the beginning of the day and checked 
out with the student at the end of the day. The 
check-in morning routine included giving re¬ 
minders to the student about daily expecta¬ 
tions, checking to see if the student’s parent or 
parents signed the DPR from the previous day, 
and redirecting inappropriate behavior. The 
checkout routine prior to school dismissal in¬ 
cluded giving verbal feedback for appropriate 
and/or inappropriate behavior described on the 
DPR. 

If the student was not successful (i.e., 
the student earned < 75% of the possible 
points on 8 of 10 days) after 8 weeks of 
receiving the basic-level intervention, then he 
or she received the basic-plus intervention. 
Basic plus included social skills training 
(Knoff, 2001) for behaviors noted by the stu¬ 
dent’s DPR performance and a lowered daily 
criterion (70%) until the student could meet 
that goal successfully for 5 consecutive days. 
If the student was not successful at the basic- 
plus level after 12 weeks, he or she was eligi¬ 
ble to receive the intensive intervention, which 
included a functional behavior assessment 
(Stage et al., 2006) accompanied by a func¬ 
tion-based intervention. 


If the student was successful in the 
basic intervention (i.e., the student earned 
75% or more of the possible points on at 
least 80% of days) for 8 weeks, then the 
student entered the self-monitoring phase. 
During the self-monitoring phase, the stu¬ 
dent rated his or her own behavior on the 
DPR and then compared the ratings to the 
teacher’s ratings. Once the student and 
teacher reached partial agreement (i.e., 
within one point of each behavioral expec¬ 
tation) for 10 of 15 consecutive days, the 
student rated his or her own behavior on the 
DPR. After being successful in the self¬ 
monitoring phase for 4 weeks, the student 
graduated. At the end of the academic year, 
87% of the students graduated, 9% were in 
the self-monitoring phase, 2% were receiv¬ 
ing the basic intervention (i.e., restarted ba¬ 
sic after moving from basic plus), and 1% 
were receiving the intensive intervention. 

The measures were administered by 
project staff (i.e., graduate students in 
school psychology or special education). As 
noted above, the SSBD was administered 2 
years prior to the current study. The CBCL- 
TRF (Achenbach & Rescorla, 2001) was 
administered in the spring of the previous 
academic year and at the conclusion of the 
current study in the spring. The DPR (Crone 
et al., 2004) was used in the check-in and 
checkout procedures with the teacher and 
the coach each day. The teacher used it to 
evaluate the student’s behavior, as well as to 
provide feedback to the student. The coach 
reviewed it with the student each day for 
checkout. The student took it home each day 
for a parent to sign. The coach provided a 
new DPR to the student at check-in each 
day. Each week, the coach entered data on 
the CCE website and used the DPR as a 
progress-monitoring tool as described in the 
previous paragraph to determine what inter¬ 
vention level the student should receive. The 
teacher adherence and quality measures 
were collected randomly throughout the 
spring semester of the study. The relation¬ 
ship measures were collected the last month 
of the academic year. 
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Analytic Strategy 

Prior to testing for the mediation and 
moderation effects, a pre-post paired t test 
was conducted with the 95 CCE student par¬ 
ticipants to test for the change in problem 
behavior over an academic year, from the 
prior spring to the current spring. The results 
showed that at Time 1, the average problem 
behavior score was 62.3 (SD = 8.7), and at 
Time 2, the average was 58.9 (SD = 8.5), 
which was statistically significant (f = -3.39, 
p < .001), indicating that on average the CCE 
students’ total problem behavior had de¬ 
creased. Therefore, the proposed mediating 
variable, average DPR percentage, was further 
assessed, and the proposed moderating vari¬ 
ables, the coach-student, student-teacher, and 
teacher-student relationship variables, were 
further examined. 

The proposed mediating effect of DPR 
on change in students’ total problem behavior 
over the academic year and the potential mod¬ 
erating effects of coach-student, teacher-stu¬ 
dent, and student-teacher relationships on 
change in students’ problem behavior over the 
academic year were analyzed using Cohen and 
Cohen’s (1983) traditional hierarchical regres¬ 
sion method. There were three separate steps 
in the analytic plan prior to testing for medi¬ 
ation and moderation: (a) assess the measures 
for potential violations of normality to deter¬ 
mine whether measures needed to be trans¬ 
formed, (b) conduct bivariate correlations to 
determine whether mediating and moderating 
variables showed the hypothesized relation¬ 
ships, and (c) assess the intraclass correla¬ 
tion (ICC) between total problem behavior 
within the nested effect of schools to deter¬ 
mine the level of explained variance by 
school assignment. 

Regarding the assessment of normality 
in the distribution of scores, Farrington and 
Loeber (2000) reported that psychiatric and 
delinquent populations often yield skewed dis¬ 
tributions on measured variables of interest 
and this would violate the normality assump¬ 
tion associated with parametric analyses 
(Tabachnick & Fidell, 2007). Farrington and 
Loeber therefore recommend dichotomizing 


the variables of interest (e.g., scores in the 
highest quartile of the distribution would be 
recoded as 1 and the remainder assigned 0), 
which allows for the use of classic multiple 
regression methods to test for mediation and 
moderation effects (Baron & Kenny, 1986). 

The second step involved determining 
the pattern of relations among the variables 
(Baron & Kenny, 1986). Specifically, the me¬ 
diating and moderating variables should be 
significantly associated with the total problem 
behavior measures to a significant degree in 
order to confirm an association exists prior to 
testing multiple relationships with hierarchical 
multiple regression. 

The third step involved the assessment 
of the nested effect of schools on students’ 
total problem behavior. Data in educational 
settings are often arranged in ways in which 
there are existing statistical dependencies 
based on the nesting of units of analysis within 
structural units inherent within the educational 
setting (O’Dwyer & Parker, 2014). Within the 
current study structure, each student was 
placed within a school and each school had its 
own unique coach, indicating a nested student- 
with-school structure, requiring further analy¬ 
sis of the variance association with this struc¬ 
tural effect. We used a multilevel modeling 
technique to determine the ICC of the school 
with total problem behavior (Kreft & de 
Leeuw, 2002). 

Finally, hierarchical multiple regression 
was used to test for mediation and moderation 
(Baron & Kenny, 1986) using Cohen and Co¬ 
hen’s (1983) recommendations. In this study, 
total problem behavior at Time 2 was pre¬ 
dicted by the first block of predictor variables, 
which included the main effects of total prob¬ 
lem behavior at Time 1 and the mediating or 
moderating variable. The second block en¬ 
tered included the interaction of Time 1 total 
problem behavior and the mediating or mod¬ 
erating variable. Significant statistical results 
for the second block would indicate the medi¬ 
ation effect or moderation effect occurred. 
When the mediation variable, average DPR 
percentage, is tested, a change from a statisti¬ 
cally significant main effect of the Time 1 
variable to becoming not significant in the 
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second block would indicate complete media¬ 
tion. However, we also tested partial media¬ 
tion, which would be indicated with the me¬ 
diating variable significantly explaining some 
of the variance between total problem behav¬ 
ior at Time 1 and that at Time 2 but not all of 
the variance (Baron & Kenny, 1986; Kenny, 
2015). 

The model for the statistical tests was 
similar for the first block in the regression 
analyses, which included the main effects of 
problem behavior at Time 1 and the relation¬ 
ship variable. The second block used the same 
main effects plus the interaction term of rela¬ 
tionship and problem behavior at Time 1 after 
the variables were centered (Aiken & West, 
1991). Centering the continuous variables 
prior to creating the interaction term reduces 
the occurrence of multicollinearity as the cen¬ 
tering deflects the scores by the average score 
in the initial continuous variable distribution, 
creating a different metric for the distribution 
of interaction scores without distorting the dis¬ 
tribution of scores itself. In addition, we tested 
the three-way interaction of both moderating 
variables with total problem behavior at 
Time 1. In order to test this interaction effect, 
a variation of Dawson and Richter’s (2006) 
test of slope differences in three-way interac¬ 
tions was used to statistically test the group 
differences in the change in total problem be¬ 
havior from Time 1 to Time 2. 

RESULTS 

The results section includes preliminary 
descriptive statistical results and bivariate cor¬ 
relations. After reporting preliminary results, 
the moderation models with adequate statisti¬ 
cal support were tested. 

Descriptive Statistics 

Table 1 shows the descriptive statistics 
of the dependent variables (i.e., total problem 
behavior at Time 1 and total problem behavior 
at Time 2), the potential mediating variable 
(i.e., average percentage of daily behavior re¬ 
port points earned across the year, DPR-Avg), 
and the potential moderating variables (i.e., 
teacher-student relationship, student-teacher 


relationship, and coach-student relationship), 
as well as a measure of the treatment adher¬ 
ence and quality of the teacher-student feed¬ 
back about the students’ performance on the 

DPR. 

Table 1 shows the total mean and stan¬ 
dard deviation for each outcome, as well as by 
the first, second, third, and fourth quartile in 
order to show the spread of scores in the 
distributions. The last column of Table 1 
shows a "-score test of skewness for each 
measure. The first three measures, total prob¬ 
lem behavior at Time 1, total problem behav¬ 
ior at Time 2, and teacher-student relation¬ 
ship, were relatively normally distributed. The 
last five measures were significantly nega¬ 
tively skewed, showing the tail of the distri¬ 
butions with lower scores had a larger spread 
of scores than would be acceptable for para¬ 
metric statistical analysis. 

On the coach-student relationship mea¬ 
sure, the first-quartile average description cor¬ 
responded to a response between not sure and 
applies sometimes for an item such as I share 
a warm, affectionate relationship with this 
child. The other average quartile responses 
were rated as applies sometimes and moved 
toward definitely applies in the third and 
fourth qualifies. This was interpreted as the 
coaches evaluating their relationship with the 
students as being uncertain in the skewed end 
of the distribution. 

On the student-teacher relationship 
measure, the first-quartile average description 
corresponded to between sometimes and often 
on an item such as My teacher cares about me. 
The average was endorsed qualitatively as of¬ 
ten for the second quartile, as between often 
and always for the third quartile, and as al¬ 
ways for the fourth quartile, suggesting that 
the students in the first quartile evaluated their 
relationship with their teachers as less than 
consistently caring. 

The students’ scores on the DPR aver¬ 
age percentage (DPR-Avg) across the aca¬ 
demic year were also negatively skewed. For 
the first quartile, the average score was 78.6%, 
which corresponds to students at the basic- 
plus level or intensive intervention level of the 
CCE program (Stage et al., 2012). The second 
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Table 2. Bivariate Correlations 



PB-T2 

PB-T1 

TSR 

CSR-DI 

STR-DI 

DPR-DI 

PB-T2 

1.0 






PB-T1 


1.0 





TSR 

_ 4 1*** 

-.35** 

1.0 




CSR-DI 

.02 

.01 

-.23* 

1.0 



STR-DI 

35*** 

.11 

— 28** 

.10 

1.0 


DPR-DI 

.16 

.17 

-,ii 

-.03 

.00 

1.0 


Note. N = 95. Correlations are shown among total problem behavior at Time 2 (PB-T2), total problem behavior at 
Time 1 (PB-T1), teacher-student relationship (TSR), and the recoded dichotomous variables: coach-student relationship 
(CSR-DI), student-teacher relationship (STR-DI), and daily performance report average (DPR-DI). 

*p < .05. **p < .01. ***/? < .001. 


quartile of the DPR-Avg scores was 91.2%, 
which corresponds to the self-monitoring level 
of the CCE intervention (Stage et al., 2012). 
The students’ average scores in the third and 
fourth quartiles were 95.8% and 99.7%, re¬ 
spectively, which correspond to the graduate 
level of the CCE intervention (Stage et al., 
2012). Therefore, the students in the skewed- 
tail portion of the distribution received DPR- 
Avg scores suggesting they were relatively 
unsuccessful and would be expected to receive 
high scores on the standardized problem be¬ 
havior measure as rated by their teachers. 

Finally, the measures of teacher adher¬ 
ence and quality of feedback also showed neg¬ 
atively skewed distributions. An exemplar 
item for adherence was linked student behav¬ 
ior to posted expectations. The first-quartile 
average was 71.7% for adherence. An exam¬ 
ple of quality would be supportive tone of 
voice. The first-quartile average was 63.7% for 
quality. Both first-quartile levels of adherence 
and quality would be described as unaccept¬ 
able treatment integrity. 

Bivariate Correlations 

Table 2 shows the bivariate correlations. 
Within the correlation matrix, three of the 
variables were transformed to dichotomous 
variables, with the first quartile of the distri¬ 
bution being coded as 1 and the remaining 
scores as 0. The transformed variables were 
the coach-student relationship dichotomous 


variable, which showed the only significant 
correlation with teacher-student relationship. 
The student-teacher relationship dichotomous 
variable was positively correlated with total 
problem behavior at Time 2 and negatively 
correlated with teacher-student relationship. 
Finally, the DPR average dichotomous vari¬ 
able (DPR-DI) was not significantly associ¬ 
ated with any of the variables. 

Thus, DPR-DI, which was used as a 
proxy measure of mediation, was dropped 
from further analysis because of the insignif¬ 
icant association with prior problem behavior 
and the final measure of problem behavior. 
However, the teacher-student and student- 
teacher relationship variables were retained as 
moderating variables for further hierarchical 
multiple regression analyses. Specifically, teach¬ 
er-student relationship was associated with 
both the Time 1 and Time 2 problem behavior 
measures, and although the student-teacher 
relationship dichotomous variable was only 
associated with problem behavior at Time 2 
and not Time 1, it was associated with the 
teacher-student relationship, so it was retained 
for further analysis as a potential moderating 
variable. 

To further assess for a potential third 
variable effect on the relation between DPR 
performance and teacher assessment of prob¬ 
lem behavior, we evaluated the association 
between teachers’ quality of feedback and stu¬ 
dents’ evaluations of their relationship with 
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their teacher. The association between the stu¬ 
dent-teacher relationship and DPR perfor¬ 
mance was evaluated with the teachers’ adher¬ 
ence and quality of feedback to the students. 
First, a c|j correlation coefficient of .86 (p < 
.0001) established a high degree of association 
between the teachers’ adherence and quality 
for those who scored in the lowest quartile of 
the DPR. Then, a point biserial correlation of 
-.26 (p = .051) showed that low student- 
teacher relationship and teacher quality of 
feedback were not significantly correlated. Fi¬ 
nally, Cramer’s V was used to test the rela¬ 
tionship of teacher quality of DPR feedback 
measured in quartiles by student assignment to 
intervention level (i.e., graduation, self-moni¬ 
toring, basic, or intensive). The results showed 
no statistically significant association (Cramer’s 
V = .325, p = .165). Together, these tests of 
student-teacher relationship and teacher quality 
of feedback using the DPR, as well as assign¬ 
ment to CCE intervention level, did not show a 
consistent pattern relating them together. 

Another potential third variable effect 
might have been that the students’ negative 
perception of their relationship with their teacher 
was due to their continued low performance 
on their DPR and not directly due to their 
perception of their teacher. To investigate this 
relationship, we correlated low DPR perfor¬ 
mance with students’ low relationship with 
teachers and found no statistically significant 
relationship (4> = .008, p = .94), so this did 
not appear to confound the results. 

ICCs Between Total Problem Behavior 
and Schools 

Because of the nested structure of the 
data, the ICC of total problem behavior at 
Time 2 within the 15 different schools was 
analyzed with hierarchical linear modeling 
(Raudenbush, Bryk, Cheong, & Congdon, 
2004), using the methods described by Kreft 
and de Leeuw (2002). The ICC was not sta¬ 
tistically significant (ICC = .039, p > .05). 
However, it was further assessed using Bar- 
cikowski’s (1981) calculation for the increase 
in the probability of making a Type I error. 
Accordingly, it was estimated to be at a = .06. 


Given that this study’s a was set at the tradi¬ 
tional level of p < .05, we proceeded with the 
one-level hierarchical multiple regression 
given that the two-level modeling would use 
an additional 15 degrees of freedom, which 
would decrease the statistical power to detect 
a possible small moderating effect. 

Hierarchical Multiple Regression With 
Moderating Variables 

Table 3 shows the results of three sets of 
hierarchical regression analyses that test the 
student-teacher relationship and the teacher- 
student relationship, as well as their interac¬ 
tion, as moderating variables of the relation¬ 
ship in the change in problem behavior over an 
academic year. The results of the tests of the 
moderating influence of the student-teacher 
relationship shown in the left-hand columns of 
Table 3 indicate that it did not significantly 
moderate the relationship in the change in 
problem behavior over the year. Likewise, the 
middle columns show that the teacher-student 
relationship did not moderate the change in 
problem behavior over the year. However, the 
right-hand columns show that the interaction 
between the student-teacher and teacher-stu¬ 
dent relationships did moderate the change in 
problem behavior over the academic year. 

In order to determine the relationship 
differences in the interaction term, the stu¬ 
dent-teacher relationship continuous variable 
was divided into two groups: The low rela¬ 
tionship group of students was defined as the 
group from the first quartile, and the high 
group was composed of the rest of the scores 
(i.e., My teacher cares about me, scoring on 
average as often to always). 

The teacher-student relationship scores 
were also divided into two groups: The low 
relationship group was composed of the first 
quartile with average scores anchored at not 
sure on the exemplar item, I share a warm, 
affectionate relationship with this child. The 
high group was composed of the remaining 
scores, which ranged from halfway to applies 
sometimes to definitely applies. Using the Dawson 
and Richter (2006) method, four groups were con¬ 
structed: high teacher-student and high student- 
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Table 3. Tests of Moderating Influence 


Teacher-Student Relationship X 

Student-Teacher Relationship Teacher-Student Relationship Student-Teacher Relationship 



Variable 

p 

R 2 

Variable 

p 

R 2 

Variable 

p 

R 2 

Block 1 

PB-T1 

479*** 

.35 

PB-T1 

.456*** 

.34 

PB-T1 

446*** 

.38 


STR-DI 

.296*** 


TSR 

-.257** 


TSR 

— 195 *** 









STR-DI 

.237** 


Block 2 

PB-T1 

.488*** 

.00 

PB-T1 

470*** 

.00 

PB-T1 

493*** 

.04 


STR-DI 

.300** 


TSR 

-.243** 


TSR 

-.216* * 



STR-DI X PB-T1 

-.021 


TSR X PB-T1 

.096 


STR-DI 

299** 









TSR X STR- 
DI X PB-T1 

.190* 



Note. N = 95. The table presents tests of the moderating influence of the student-teacher relationship (STR-DI) and the 
teacher-student relationship (TSR), as well as their interaction (TSR X STR), with problem behavior at Time 1 (PB-T1) 
on problem behavior at time 2. R 2 is the amount of variance attributed to the block of variables. The STR-DI variable 
was a dichotomous variable using the lowest quartile, and TSR was centered prior to entering it in the regression 
analyses (Aiken & West, 1991). 

*p < .05. **p < .01. ***p < .001. 


teacher relationships, high teacher-student and low 
student-teacher relationships, low teacher-student 
and high student-teacher relationships, and finally, 
both groups evaluating their relationship as low 
(see Figure 1). 


A depiction of these groups and their 
respective scores from Time 1 to Time 2 on 
the total problem behavior measure is shown in 
Figure 1. The test of slope differences showed 
that the group with low teacher-student and high 


Figure 1. T Scores for Total Problem Behavior 



—•— Lo Teacher & Lo Student Relationship 

-Hi Teacher & Hi Student Relationship 

A Lo Teacher & Hi Student Relationship 
• Hi Teacher & Lo Student Relationship 


Note. The T scores from Time 1 to Time 2 on the total problem behavior measure are shown. Using the Dawson and 
Richter (2006) method, four groups were constructed: high teacher-student and high student-teacher relationships (Hi 
Teacher & Hi Student), high teacher-student and low student-teacher relationships (i.e., Hi Teacher & Lo Student), low 
teacher-student and high student-teacher relationships (i.e., Lo Teacher & Hi Student), and finally, both groups 
evaluating their relationship as low (i.e., Lo Teacher & Lo Student). 
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student-teacher relationships showed a signifi¬ 
cant decrease from Time 1 to Time 2 (t = 2.448, 
p < .05) and that the group with high teacher- 
student and high student-teacher relationships 
also showed a significant decrease from Time 1 
to Time 2 (t = 3.376, p < .01). 

DISCUSSION 

The most important finding of this study 
was that student-teacher relationships moder¬ 
ated the treatment outcomes. Specifically, Fig¬ 
ure 1 shows the interaction by the low teacher 
and high student relationship pair with the 
high teacher and low student relationship pair 
in which the low teacher and high student 
relationship pair showed a significant reduc¬ 
tion in problem behavior. Similarly, there was 
a reduction for the high teacher and high stu¬ 
dent relationship group, indicating that the stu¬ 
dent’s endorsement of items such as My 
teacher cares about me moderated treatment 
outcomes with a reduction in problem behav¬ 
ior regardless of the teacher’s rating of the 
relationship. 

Although the current study did not ex¬ 
plicitly test the functional relationship of all of 
the students’ problem behaviors with their 
maintaining consequences, the results could 
be construed similarly to the study of Mc¬ 
Intosh et al. (2009) in that students reinforced 
by teacher attention would probably be more 
likely to endorse items such as these. In addi¬ 
tion, within the clinical child research litera¬ 
ture, a positive child-therapist alliance, which 
is measured similarly, showed better therapeu¬ 
tic outcomes (Kazdin & Durbin, 2012; Shirk 
et al., 2011). The contrast of this result was 
that students who suggested that they had re¬ 
lationships we typified as inconsistent with 
their teachers remained above the borderline 
clinical level in total problem behavior. This 
suggests interventions such as CCE or CICO 
would not be effective for students who do not 
view their relationship with their teacher as 
particularly caring or socially rewarding 
(McIntosh et al., 2009). 

The anticipated mediating effect of DPR 
yearly average on the reduction of total prob¬ 
lem behavior did not occur. Recall that the 


DPR was conceptualized as the therapeutic 
mechanism in which the teacher gave explicit 
behavior expectation feedback and was also 
the progress-monitoring tool that identified 
when the student had graduated from the CCE 
intervention or when he or she needed more 
intensive intervention. In a treatment utility 
study of DPRs, Stage et al. (2012) found 
coaches’ use of the DPR and assignment to the 
different CCE intervention levels corresponded 
to the T scores of externalizing problem be¬ 
havior (i.e., graduate = 58, self-monitor¬ 
ing = 61, basic = 62, basic plus = 67, and 
intensive = 69). The current study showed a 
similar pattern of T scores for CCE graduates 
(87% of the total sample) and students in the 
self-monitoring phase (10%), although the ba¬ 
sic-level and intensive intervention-level stu¬ 
dents showed elevations similar to graduates 
(i.e., graduate = 58, self-monitoring = 63, 
basic = 60, and intensive = 58), indicating 
that the differentiation of the students’ prob¬ 
lem behavior by their DPR performance did 
not accurately reflect their teacher’s evaluation 
of their total problem behavior or the use of 
the DPR in the treatment manual (Cheney et 
al., 2004). 

To further assess for a potential third 
variable effect on the relation between DPR 
performance and teacher assessment of prob¬ 
lem behavior, we evaluated the association 
between teachers’ quality of feedback with 
students’ evaluations of their relationship with 
their teacher and the students’ assignments to 
CCE intervention levels (see Kratochwill et 
al., 2012, for an explanation of this type of 
effect). Together, the results of student-teacher 
relationship and teacher quality of feedback us¬ 
ing the DPR, as well as assignment to CCE 
intervention level, did not show a consistent pat¬ 
tern relating them together. In addition, we 
found that students whose average DPR percent¬ 
age was in the lowest quartile were not signifi¬ 
cantly associated with low perceptions of their 
relationship with their teacher. 

In conclusion, research about the thera¬ 
peutic mechanisms of behavioral feedback 
interventions such as C&C and CCE show 
mixed associations between adults’ (i.e., teach¬ 
ers’ and coaches’) relationships and students’ 
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reduction in problem behavior (Anderson et al., 
2004; Tsai & Cheney, 2012). The current study 
provides new insight by identifying a unique 
moderating effect of the interaction between stu¬ 
dents’ and teachers’ relationships, where stu¬ 
dents’ positive perception of their teacher rela¬ 
tionship resulted in a reduction in total problem 
behaviors. It is possible that this effect is best 
explained by operant behavioral principles (e.g., 
McIntosh et al., 2009), where students’ view of 
their teachers is positively reinforcing. 

Limitations and Future Directions 

There are several limitations to this 
study. The sample was a combination of a 
previous treatment group and wait-list control 
group, so the group receiving prior interven¬ 
tion might have responded differently than the 
wait-list group, even though statistical tests 
found no significant differences between them 
at the start of the study. Another limitation of 
this study was that the relationship between 
CCE intervention level assignment and total 
problem behavior did not appear to be consis¬ 
tent with the manualized version (cf. Stage et 
al., 2012). It may be that external oversight is 
required to have the school staff follow the 
multiple treatment level decisions found in the 
CCE manualized treatment. Kazdin and Nock 
(2003) noted that establishing mediation ef¬ 
fects in treatments requires specification of the 
mechanisms in relation to the manualized 
treatments. The results of this effectiveness 
study did not adhere to the manualized version 
of the CCE and, as such, might suggest that 
the average DPR percentage was a poor can¬ 
didate as a mediating variable. Finally, even 
though the interpersonal interaction between 
the student and teacher moderated the overall 
change in problem behavior over an academic 
year, the proportion of variance was small, 
accounting for an additional 4% of the vari¬ 
ance in the outcome measure beyond the main 
effects that accounted for 38% of the variance 
in total problem behavior. In addition, there 
was a slightly elevated level of making a Type 
I error as described in the section in which 
the ICC was tested for the nested effect of 
schools. Moreover, the three-way interaction 


of students by perceived relationship with 
their teacher and vice versa showed that the 
majority of students perceived they had a good 
relationship with their teacher and vice versa; 
thus, the sample size of students and teachers 
who perceived they had a limited interpersonal 
relationship was small and would suggest rep¬ 
lication is needed before it is considered a 
generalizable effect. 

Because the results of our study showed 
that students’ perception of their relationship 
with their teacher significantly contributed to 
their reduction in total problem behavior while 
in the CCE intervention, future directions 
would include the use of functional behavior 
assessment after a shorter period for the stu¬ 
dents who were not making progress to deter¬ 
mine the maintaining function of their prob¬ 
lem behavior. Students who are not motivated 
by teacher attention or do not perceive that they 
have a caring relationship with their teacher are 
unlikely to benefit. Together, this study and that 
of McIntosh et al. (2009) show that one size does 
not fit all when it comes to using a Tier 2 
behavioral intervention reliant on teacher social 
reinforcement. 
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